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>.r,»r ABSTRACT 
■■■■■■ '^'i '--A^-V 

DIAGNOSTIC INSXkUMENT FOR ASSESSING THE SKILLS 
AND ATTITUDES OF REFERENCE LIBRARIANS 



Jhe test developed /in this paper assesses several major skills 
of reference librarians':, question analysis, seleeflton of appropriate 



source, and actual use/ of the source, Including selBctlbn of apprciprlate 

siftjecf terms, through simulated reference V^stlons and. ajiearbh 

exe*else In a standardized list of subject headings. It also ir^vl^es 

a means of determining the attitudes of reference librarians/ toward ' 

■ ' /'■ 
problem-solving, dlrict and Indlrec^^ work, and -Instructional 

and Informational modes of service. The test has been us^d'wlth; ' 

foreign librarians Jmployed In U. S. Information Ageney/llbrarl6s In 

Europe, the Middle East, and North Africa,^ and with library school students 

at the University of Maryland, where it Is used to evaluate students" 

seeking tp waive thabaslc refaranoe oourse because of previous related. 

' ■ ' ' ' f ■. ' ^/ ■ ■ ' . " ^ ^ /■ - ■ ' . ... .. .. 

course work or experience* 
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DIAGNOSTIC, INSTRUMENT FOR ^SESSING THE SKILLS 
mo ATTITUDES OF REFERENCE LIBRARIANS 



^ -.. , _ _ _ . _^^v4s.^'^^ 

. INTRODUCTION 



: This diagnostic instrument i^* a modification of, a test devel^iped 
to assess the.skiUS and pttl>udes of participants in the U. S. 
Information Agency/ Training Program for European Librarians , Cathdlld 
University of America,' 1577.1 it been used for a similar workshop 
given in 1978 for librarians In the Agency's libraries in the Near 
East and North Africa -and to assess students seeking waiver- of the 

bMlc^reftfrence. course^atJbhe University of Maryland, -Cc^llegerof 

Library and Inf omatiori ServlGes. : ^ > , ^ 

The following Is a brief putllne of the^lrtstrumejit, which Is - ' 
Included In Appendix As ' 



, Seotlpn 1 . VSlmulated referent questions 



Jj. Section 2. IdentlfylHg relevant subject headings 

/ jf Section 3. /Attitudes toward direct and Indirect pferenc^/ service 

Section th. Attitudes, toward Instructional and Informational reference 

7.v%^^/ , service ' ^ •. . . ^ . ■ ' 

Section 5, Attitudes toward problem-iolvlng ^ - 
j| Time for completion ranges from 1* to 31 hours, with the difference due 
4| primarily- to. speed in completing Section 1. The respondent must' have 
'i^'ccess to a Reference collection llkply to^ contain the reference sources ' 

[listed in the key, to Section 1 (Appendi^c B). Sections 2 through 5 are " 
\ iBelf -contained. \ ' - 



dlfl not have these ikllls, arid students .waiving the basic coujse-at 
Maryland, are urged to take a .course which. In corp States the use of Wine 
iystems;lf:.T,they^do~not-already have- these sklU^^ ^ - 



^'pUIDELINES FOR INTERPRETING RESULTS ' " . . ' . . 

'. Reference Skills , . ' " 

Section! contains fourteen questions designed, to test the rftspon- 
dent's knowledge of , search heyristlgs likely to be developed^ during 
a basic reference- course or through' reference ^experience. ^These include;' 
for example, identifying a recent book by reference to 'the subjedt, ' 
upda ting a biograp hica l entry, jading ^aistatistlcaLtable . All- of- the 
answers, can be located In reference sources usually contained in a 
medium-sized. public library or. in an undergraduate academic library ^ 
collection. A key is included in Ap,ftndlx B for these questions, ihdlcatln 
Ipni or severai, sources of the porreet answer. 

In assessing this pottlon of the test, answers which do not match 
the key should be- checked for accuracy. Two scores should be determined; 
-percentage- correct responses of all possible .repponsesV based on fourteen 
questions, counting the parts of questions separatelyi and time per correct 
answer. /The latter is computed by d^Wding the total tlmi required to 
answer the questions, rounded to the nearest 15-minute Interval bv 

■ . ■ ■ . ' ■ - 

numbed of correct answers. ' ' . 

To allow for. variations in response caused by collection quality, 
the directions isk the respondent to include search strategy development 
fbr: questions which could not be answered. Included in the strategy Is' " 
.Identification of the generic tool, with its qualifiers, which should " • 



logically contain the answer. In Question 2, for example, the strategy 
should indicate "a map of Illinois with .counties and county seats, likely 
to be found in a U.. S. atlas. The examiner can judge the effectiveness 
arid logic of the search^ strategy . If the test^llecjion is un^n@w.nj_ 
the examiner may provide the respondent after the test with a list 
of sources containing the answers and ask him to Identify those in 
the teat collection. This information, together with strategy, allows 
1 the -examiner to attribute the reason for perfdrmance failure to collection' 
quality, knowledge of the collection, br^use of sources. 

The second segment evaluates the librarian! s ability to select 
useful subject headlngk from the Library ^ Congress' Subject Headings 
and to modify a search using standardlztfd subject terminology. This 
exercise provides a basis for assessing the librarian's skill at'con/ " 
ducting subject searches in a card catalog, since this system is used 
widely to provide subject access to books and other library'frfaterials . 

-The specific objectives of the four questions in this section 
are to evaluate the respondent's ability to Interpret; ,' 
-a scope note, explaining coverage of a particular term 

- a see also reference to a related subject heading 

- subdivisions of subject headings, I.e. hierarchical arrangement, and 
form subheadings 

- a see reference from an entry term to the Standard term 

The score is the number of correct answers, and should 'be accompanied 
by a diagnosis of the reasons for" ftrrpr, -based on the objectives indicated. 



' . ■ ' ^ ; = 



Attitudes Toward Refertnpe W ork V ' 

^ectlons 3 through 5 assess attitudes whlcFaffect Job perforaianci 
. In reference. Sedtlon 3 assesses the preference .for ^direct or Indirect 

f ^^f^L^^tfr^f^^.^lO^^lyes direct jper«,nal contact jflth'. . .;/ 

the^user, usually by anw^l/igy reference questions at a r^erence^desk ' 
or through bibliographic instructloni indirect is supportive of this 
direct contact, frequently through bibliographic activities, but Involves / 
11 ttW personal interaction with the user. In this Section, Questions 1, r 
5, and 7"relate to d^4ct servlcei 2, 3, ^, fi, 8, and 9 to indirect service, 
rdeally there should/be some blending of the. two groups, but an obvious /i 
-preference for lndire4t reference service may Suggest an Inability to work 
weir with the public. /. " 

Section 4 asks the respondent to indicate his preference for, / 
n Wchihg the user how to find' the information or actually providing t^i'e 
information. The latter Is more closely aligned with special reference ' 
service ^ tje former with public or apademic library service. There is 

some Indication that librarians who feel inadequate for one reason^r 

: ! - .' . ^ ■- - - : ... ■ - ■ . - ^ - • - . -/ ' 

.another In dealing with a patron are likely to prefer an instruc;dlonal 

■approach, but this is not the oniy reason for this preference, ind It 
may simply reflect a philosophical orientation to a librarian's" role. 
, Many librarians philosophically view themselyes as teach 
. *J ^" institution- for self .education and t^Ms eipouse the instpUci 

j tibnal mode of Service. • . 'hi ; 

Yhe last section IncorpoNtes an instrument 'to assess attitudes' ' 
toward problem.solving devised by Carey (1958). The emphasis in this, v H> ' 
instrument is on altitudes, not on eapabllity| however, the scale derived ' 
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from. this Instrument has predictive >?aildity in that thi scores have a ' 

• b -- ' ••. ' ■ ^ " f' - ' ' ■■ '■■ ■■ . ^ ■- \ ■- . 

positive relationship to performance In experimental problem-solving 
situations.^ The scale is not Included in Appendix A, but Is reprinted in: 

-Wvn'"ferShii^andTac^^^^^^ Attitudes 
(New York: McGraw Hill, 1967), pp. 268-70."*' " . - ' 

To score this section, "response "alternatives for poiltlve statements 
should be. weighted from 5 (strongly agree or almost^ always ) to 1 (itrongly 
disagree qr almost never). Weights for negative Items (Questions 9, 14,' 
15, 18) should be reversed. A person's score Is thi sum of the weighted 
alternatives he .endorses. High scores Indicate a pUltive attitude toward 
problem-solving situations and demands" (Shaw and Wright, 1967). The mean 
SOTr^f or^emaies Ts 57.61, fot Talet 62. IZ-^espondents scoring hlghTn 
this s^ipn should function effectively in the problem-solving aspect " ' 



- : .. • ■ . -footnote;s. , V. ,=1. '■- 

- , ^The author was Coordinator of Curriculum and Instrudtlon 
program. ' ■■ 
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Appendix A 



. ' DIAGNOSTIC INSTRUMENT FOR ASSESSING THE SKILLS ANo' " ° ' - 
. ^ ATTIjrUDES or REFERENCE LIBRARIANS' ~ . ■■*•'.;;' 

-- . ■ ' • ^ '1 . -v- - 

■ ^ Jf^is diagnostic Instrument PMvidfe . Inf ormatlbn - 

about your skllif In and^^^a^^^^^ toward referenee woFk. v You should 

. work alone, and^pllow the dlrectio 'Tl„e ' 

to be allocated for completion of eacH seetlon la Indicated with ^ ' . 

.each section. The order may bfcAsfilfted at./the escamlner •sjiseretlon. 
Please read the dlre^aoni for; each section completely blfore startlnq 
eacn section, ^, ■, - : ■ ,. - ^ . » 



.Section 1. SipLATED REFERENCE QlESTi0NS\. (3 hour, inaximumf , 



Dlrecftlons ; n^ppgoach a^^ciuestions as^ thdugh theyr Were retail / • ^ • 

- ' : fluestlons and ipcat^ ari^^^^^ 
consult^any, source 'except another- person For aU questions , provide^, 
a brief clta-tlon to the; actual source of t^ie answer-, IncluditigJ the- 
entry under whlph. 4t was located . Example^ Ql^dt . of Ajn. Biog'. , v.' V, 
,p,.170, undej Adama, H. For the asteElsked questldns, ilso pravidd 
the answer^ briefly . ^, a - • •■ • . •" • 

If you c annot locate the answer , pletfse do the- fbllbWlna: ' 

- list the first three four oas you triad |lrfeiudln 

Example: Cu^Mnt Blog.^ IMS, oindar, Smith; D.^,^ 
/ ' America, 1957, under Sm^ 

\; ' Smith, David G* I L^^ ^ ,p ^ ^^^^^^ / ' 

- then, dascrlba the kind of refereTi think you 

could find the answer, Ineludlnp approprlate^quallfitfrs* 

, ' Example: A retrospective biographical source covering Ame^^ 
' Statesmen iWlth name: access ■ / 



.IMPORTANT 



Plaase note th# trme ;,lt takes you to compiete this 

segment of the test and Indicate It at the eftd of l; 

the questions. You- may not take longer than three hourft 
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- Questions: ..^ 

* 1). . Is Irving Berlin still alive? 




-* ?) What is trie county, seat of KnoH.Countyi Illln'ols? , , ' T** 



3) .Churchill first uied the' term Iron Curtain in a speech he ftiade 
..in the U. S. - When and-where_,did he -make this speech?, s 
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-4) Can^ou locate a copy of it for me? (Bibliographleally, not physl^^ally) 

. f . _ . =" • ■ - , ■= .-■ ^ . .\ — ■ _ : .... ■ - - ■ ■ ... , , ; 

5) I know that the Secret Service has responsibility for providing' body- 

^ ^ik- Jot cartain public .officials and, their f amiJies undef-M ww . 

Who. falls under their- protection T I do nqt 'need specific names - 
titles or relationships will be sufficient.' ' 



€) Elihu^Root was a noted. Republican Senator in the early part of the 
' 20th century. Whst was* his position. regatding the League of 

Nations .WHten American membership was being discussed In Congress?' 



• 7) How many American marr-led women with children under school abe 
' were employed in ' If 77? . ' ' ; 



8) , I need a bibliographic citation to' the hearings "on the effectiveness 
of federal bank -regulation that were h&ld in Congress in Sprinq, 1976. 
They related to the Franklin National Bank failure. * 



* 9) What was the namrf of the black jyoman singer Ishb sang at President 
, , Lyndon Oohnson's funeral? ,' > . . • 



10) What newspaper in St.aouls has the largest circulation?" " S' 



• ■■ ; ■ 



11), : During his first term of office^ President Nixon encountered 
ma^lor difficulties In securing sen^^^ of his 

appointees to the Supreine Court. 3ustlce Rehnqulst was 
approved In 1821,' but only after critical scrutiny. What 
were the inajbr objections to him? " y 

* 12) How did S,enatqr Proxmlre vote on Jrt 



13) T need the 



, and title of a fairly recent (i.e. , published 

between 1978 afld.1981) book about Newflelds, the planned community 
,1/1 Ohio. ' 



1^) Where can I find a pltoture of the Picasso sculpture he donated 
•to the city Chlcagb^, the rust- crflored one that is in the 
plaza of the Chicago Civic Center? '. 



-■■ i,' 



tion (Bfe s 



Time for Qompletion (Bfe speeifig) j 
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Section 2 1 ibENTIFYINQ RELEV^T SUBOEGT HEADINGS (15 minutes) 

Directions: Attaohed is a page of subject headings from the Library of 
; Congress Subject Headings (Sth ied, ), Using the antrMs on 
this pagei select the subject heading you would search under first to 
loc^ate the folldwlng books In your eatalog, (Remember your entry shpuld 
always be the rnost specific possible,) . 

I) A book on^ British civil service pollbles about the hiring of nationals 
in India In the nineteenth centuryi 



2) A book on the sociology of the bureaucracy *whlch analyzes several 
^government agencies: ' , / 



3) A handbook on how to get minority groups to apply for civil service 



A) How can I broaden my smi^oh In no* 3 if there are^no books under tha^ 
subject heading? • ' ^ 



What kind of Irrelevant fftiiterlal would I get with this approach? 
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Ui\ $. ^ Library of Congress. 
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-^Podtions 

QvU a^vioe podtioai ^ 
— Rtcnu^ ' 
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Section 3s ATTITUDES TOWARD DIRECT AND INDIRECT REFERENCE SERVICE 

Dlrectionii The questions In this section will Involve your making 

judgments about the tasks described below. They are tasks . 
performed nbrntelly in reference departmei^s. Please read them carefully 
and, If necessary^ refer back to them when responding to the questions, 

1) Finding a factual, answer for a patron ^ • ^ ^ 

2) Writing an adminlstratlye repor% on reference services 

3) Develop|hg a referral file j 

4) Evaluating a portion of the library's reference collection ^ 
'5) E)<plSining to abuser how to use a particular reference tool 

6) Preparing a selection policy for reference materials In^a subject are 

7) Giving a talk to a group on reference materials the library's 
collection ^ , . , 

8) Cpordlnatlng some aspedt of reference work with another library 

^ jt - ; . > 

9) Compiling a bibliography which .requires Judgment about the quality of 
works Included . ' 



1 ) Which task wduW you most prefer doing? 
1-1) Why? 



1.2) ^Whlch would be your second choice? 
'= ■ ■ ' ^ 

2) Which you least pre/er doing? % 

2-1) Why? ' f 



5) Which of the. tasks do^you consider most professional? 
, 3,1) Why? 



Jp2) Which would you consider the second most professional task? 

4) Whlchftask do ,you consider the least professional? ' 

>.l) Why 



Section 4i ATTITUDES TOWARD INSTRUCTIONAL/ INFORMATIONAL REFERENCE 

. SERVICE • ' ; : 

■■\ ■ ■ • • . . ... . r ' \; ■ 

Dlrectlonsi The following two paragraphs deaoi'ibe different approaches 

td reference work* Read them carefully and answer the follow- 
ing queistldns in relation to them, the numbers within each paragraph 
refer to the specific thought precedlhg them*" Pleaie disregard them In 
your Initial readlngi they wlll.be referred td In a question^. 



A) I generally prefer to provide the Information Itself rather than go 

through the prooess of telling the use^ how td find It., (1) Of ten. the 
questlon-ansvyerlng probess la considerably, quicker when I do It/ (2) And 
I am a little wary of providing the user with the limited knowledge about 
sourojes I can give him in a brief .eneounteri he may feel that all of his, 
future queatlons can be answered thrcugh the same strategy when another'^ 
would be more appropriate. (3) Also I am not sure how* Important It Is 
that he know how to find the Informatldn* After all, It Is the Information 
Itself is mpre Importanti not knowlhg how to find It, (#) 

•B) I W0ul4 prefer to Introduce someone to the appropriate Information 

souroe and teach him how to use It rather than provide the answer for 
him/ (1) I feel that the patron benefits more^from finding the Information 
himself rather^ than Its being provided 'by the librarian. (2) Particularly 
In the casei of peop»le Involved In formal course wopk, finding Information 
is. simply an extension' of the coursework.. The librarian should Interfere 
in the process only to ^he point of showlnr the student where to flnS It 
and explaining how to use a reference book. 0) Even If providing 
instruction is more ^tlme- consuming In the shoi^t-ruhVln the long-run ihe 
patrofKwlll make fewer demands on^trie referance librarian because his" own ' 
skill In using Mfer^be materials will Increase. (4) Developing self- . 
sufficiency in ysing the library should be the goal of every library 
user. (5) ^ ■ . ^ ^ 



Other considerations over which you have no control, such as time 
canstraints and institutional policies. Influence your behavior in respond- 
ing to a question. Please disregard theses however; In answering the 
following" quefWons since the objective is to develop an accurate picture 
pf your philosophy of reference service. ^ ' ' 

^ . ; 1^.'. ^ ^ - ' 

1) You may disagree with IndlvlduaL sentences in each paragraph, but 

considering each paragraph a^'aiWiolf, which more accurately reflects 
your own phllOTpphy of Reference services? , ^ 

If you are not jj\ complete agreement with the paragraph you selected, 
which of the serftenoes or groups of sentences did you disagree with? 
(Please note that.^he sentences are numbered with the nurhber following 
each sentence. Respond by indicating the specific number of the 
sentence or sentences.) \ • > , ^ / 



^.IJ, Why? V 



. Appendix B . 

■ , *• KEY. TO SECTION 1, SIMULATED REFERENCE" QUESTIONS, AND 
« ' SECTION 2, IDENTIFYINC RELEVANT SUBOECT HEADINGS 

: - ^ ^ ■ ^v.- ■ - ■ ■ 

Section 1. SIMULATED REFERENCE QUESTIONS 

' ^ ' * ' ^ ' ^ . ■ i,-. ■ ■ '. 

1) V«9, as of May 1981. Wib's Who In America, 1980, under Berlin, Irving; 

; updated by checking In Facts on File or New York Times Index, under 
"Deaths," then m the obituary section In Time. 
■ Notes' The correct answer should Indicate updating a standard source. 
Best answer would Include the most current news magazine and perhaps 
the dally newspaper beyond Its coverage, A feasonably good answer 
would Include the New York Times Index or Facts oh File. If Berlin 
dies, he should be replaced by a- person who would require the same 
strategy. . . , r 



2) Galesburg. , World Almanacj 1981, under entry *of; Countles-U.S. , in 
■Indexi Census and Areas and Counties and Seats, Illinois, Knoxi p. 961. 

3) Bartlett's Quotations, 14th ed., under Sir Winston; Spencer Churchill, 
p. 924b, 3d entry. " ■ 

4) Speech Index, 4th ed., p. 147, under Churchill, Sir W. L. S. Sinews 
^of Peace (Speech at Fulton, Missouri). The "Iron Curtain Has 

Descended" is the same as the Sinews of Peace speech. Six citations 
are given. _ , 



5) U.S. Government Manual, 1979/80, p. 482, col. 1,' first paragraph, under 
Department of Treasury, U.S..Sectet Service. 



6) DAB, V. XJ, part Z, Supplement "2 to December 31, 1940, under Root, , . 
Elihu. Article begins on p. 577 r actual answer Is. on p. 581, 1st 
column, 1st paragraph.' , ■ ' ^ • 

7) Statistical Abstract, 1977VTahle 659, p, ^05, .located through 
index under the entry T Employment, Women. / ^ 

Aooordlng to thli table, whleh presents ctata of Mar eh , 1977, , . 
4,«5,O00 women, at least 16 years old married with husband 
present .and with children under six, wbre employed in 19^7, , An 
additional 36fi,000 women, with Same qualifications but 
apparated from their husbands, were employed in 1977, , Tfne ? 
correct answer Is either the first fJLgure with all qualifications 
or the sum of the two Mgures, again with jill qualifications. 
. Divorced wome'h should^fi.ot be Inolufledj and the figures must be* 
in ^thousands, which is indicate^ in a table note. 



■ . / ■ ' ^ ^ ^ : \ ' ■ ' , 

= • ^ ' . , .• T'. -^-/-r. 't:- ■ - ' " ^- ■. • " : ■ ' . ' . " ■ 

: 8) PAIS, v^. 63 (1977), P» 395, col% 2v^ under Franklin National ^ 
\ = Bank j seqond entry. , , - 

9) \New York tlm|a Inde^j 19 Lyndon Balnea, iPuneral 

V: liervice p. col,: 2^ "2 aolos sung" . * * -If ^esponderit doas not 

/; l^noy^ Is^ black I he may have to verify tHat* , 

Rloture of singer is given In Newsweek^ funeral article* Newswee 
^ February 5, 1973, 'p,^ 32. Ref erenee td this article in Reader's ©jlde, 
j ^ 1973/74, under Dohnson, Lyndon Balnea, 

10) Aocordlng to^the 1979 AyW pp. 508-09 

. under Mlssourl--St* Louis,: then under newspapers' names* p. 508, 
Globe Demoprat, if dally circulation is the criterion^ p. 509, if 
Sunday circulatlQri Pdst Dispatch, Answer varies so^ 
basis for selection should be given. 

1 ' ' P 

^111) Cprigresslbnal Quiarterly Almanac, v. 27 (1971), located In the Index 
I und^er^Rehnqulstp-Supreme Court cpnfl 851-59. 

Ma jbr objections are listed on p.' 852* unties Reactions." - 

12) / Congresslonal-OJartar^ 67-S in Roll Gall * 

Votes section, .under no/ ^17 p Wlsconslri^ Pro^lre** ft*oxmlre voted 

ye^. ^ . / . . ^ . . ' y ' . ... 

13) SubjeA Guide to BIP, 1980,. p. 1003v 'under City Plaftning-^U. S. , 
then drowse to locate a bobk by frederick Steirier, The Politics of 
New Town Planning? The Newfields, Ohio Story, published In 1980, * 

14) World Book Encyclopedia, v, 3, under Chicago | located by checking 
index under Picasso. ^ - 




Section 2. IDENTIFYING RELEVANT SUB3ECT HEADINGS. • 



1) . Civil Servlce--Great%rltaln--Colonles--Ihdla • ,' 



2) Bureaucrfcy 



3) Ci vll. Service' Recruiting- -Hpndbooks 



4) Several approaches, could be used broaden the search^ , ^ 

Recruiting of Employees.-- would ellmlnaterthe Civil Service aspect 

and indlude employees Ih the private sector , 

Civil Service Positions - may desorlb,e the kinds of posltloriS 

available r° recruiting c^uld be treated as a related topic In a book 

With thls'^subject heiding . 

Civil Service - very broad approach. This term' is likely to be given 

to books dealing generally with Civil Servjcei any reference to 

recruiting of minority .groups is llkeljj to be mlniraal unless -the 

•book deals generaily^i^th the Civil Service-related problems of ' 

mino'rity groups. 



